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Let G C iR*' be a convex polyhedral cone with vertex at the ori- 
gin given as the intersection of half spaces {Gi,i = 1, ■ ■ ■ , N}, where 
and di denote the inward normal and direction of constraint associated 
with Gi, respectively. Stability properties of a class of diffusion processes, 
constrained to take values in G, are studied under the assumption that 
the Skorokhod problem defined by the data {(rii, d^), i = 1, ■ ■ ■ , A'^} is well 
posed and the Skorokhod map is Lipschitz continuous. Explicit conditions 
on the drift coefficient, b(-), of the diffusion process are given under which 
the constrained process is positive recurrent and has a unique invariant 
measure. Define 



Then the key condition for stability is that there exists S G (0, oo) and 
a bounded subset A of G such that for all x G G\A, b{x) G C and 
dist{b{x) , dC) > S, where dC denotes the boundary of C. 
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1. Introduction The stability properties of constrained stochastic processes 
are of central importance in the study of queuing systems that arise in computer 
networks, communications and manufacturing problems. In recent years there has 
been a significant progress in the study of stability of such systems ^| El HI IHl 
SI El 121 El El Q' AH the papers in the list above which treat the heavy traffic 
diffusion model consider the case where both the drift and the diffusion coefficients 
are constant. However, in many applications a homogeneous model of this kind is 
not well suited, and it is enough if we mention systems where there is a control that 
depends on the system's state. Although a similar motivation leads one to also study 
variable constraint directions on the boundary, we confine ourselves here to fixed 
directions. In fact, some basic stability properties of the corresponding Skorokhod 
map, that we take advantage of here, are not yet well understood in the setting of 
variable directions of constraint. 

In this paper we consider the stability properties of constrained diffusion pro- 
cesses when both the drift and the diffusion coefficients may be state dependent. 
Let G C M'' be a convex polyhedral cone with vertex at the origin given as the 
intersection of half spaces {Gi,i = 1, • • • , N}, where rii and di denote the inward 
normal and direction of constraint associated with Gi respectively. The stochastic 
processes considered in this paper will be constrained to take values in G. One 
of our central assumptions is that the Skorokhod problem defined by the data 
{{di, Tii); i — 1, - ■ ■ , N} is well posed on all of Dc{[0, oo) : M'^) (the space of func- 
tions (j) which are right continuous, have left limits and 0(0) £ G) and the Skorokhod 
map r : Dg{[0, oo) : JR'^) Dg{[0, oo) : 5?*^) is Lipschitz continuous. We refer the 
reader to ^2 lEl [Z| for sufficient conditions under which the Skorokhod map is Lip- 
schitz continuous. The paper |19j studies networks of single class queues for which 
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the Skorokhod problem associated to a diffusion approximation is regular. Some 
examples of feedforward networks which lead to a regular Skorokhod problem have 
been studied in jl7l IT^ . An example of a multiclass networks with feedback which 
leads to a regular Skorokhod problem has recently been studied in [Hj. 

In this paper we consider the constrained diffusion process {X^(t)}f>o given as 
the unique solution of the equation: 



We assume global Lipschitz conditions on a and 6 (cf. (|2.4(l ^. the boundedness H2.5|l 
and uniform non degeneracy fCondition l2.4(l of the diffusion coefficient a . The main 
result we present is that under the above conditions the Markov process {X^(t)}f>o 
is positive recurrent and has a unique invariant measure if there exists a 5 e (0, oo) 
and a bounded subset yl of G such that for all x E G\A, b{x) E C{6), where 



and dC denotes the boundary of C. The Lipschitz conditions on a and b are assumed 
to assure that there is a unique solution to the constrained diffusion process (|l.lf) . 
As we point out in Ii.emark l4.1l our main result continues to hold if these Lipschitz 
and growth assumptions are replaced by the assumption that 1)1. 1() has a unique 
weak solution for every x E G and the solution is a Feller Markov process. It should 
also be observed that the non-degeneracy assumption on a and the Feller property 
are used only in Section 4 in proving the ergodicity of the constrained diffusion 
process, and are not needed to prove stability. 



(1.1) 




C{5) = {veC: dist(w,aC) > 6}, 



and 



C = 
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As in El Q] the key idea in the proof of this result is to study stabihty 
properties of a related deterministic dynamical system. In Theorem 13.21 we show 
that for each 6 > 0, the family of deterministic constrained trajectories defined as 



for which v{t) G C{5), t e [0, oo), enjoys strong uniform stability properties if for 
some S e (0, oo), v{t) G C{S) for all t G [0, oo). These stability properties enable us 
to use T[x), the hitting time to the origin (cf. I|3.14|l . as a Lyapunov function for the 
stability analysis of the stochastic problem. We study some basic properties of T(-) 
in Lemma rm The key consequence of the stability of H1.2|l is Lemma mi fiii). This 
result along with the Lipschitz property of the Skorokhod map leads to Lemma 
14. II which is the crucial step in relating the stability of the deterministic dynamical 
system (|1.2|l with that of the stochastic system . Stability and instability results 
for reflecting Brownian motion have been obtained in a number of different settings. 
The papers |21[ fTl) consider the two dimensional case with constant and non- 
constant directions of constraint on the two faces of the domain, respectively. In 
conditions are presented which guarantee the stability of a multi-dimensional 
reflecting Brownian motion, and in addition characterizes conditions under which 
the invariant distribution has a product form distribution. The paper also obtains 
sufficient conditions for stability for this class of processes. 

Our main result is Theorem 14.11 where it is shown that there is a compact set 
B E G for which the hitting time: 



has finite expectation which as a function of x is bounded on compact subsets of G. 
Proofs of such results generally use a Lyapunov function that is in the domain of 
the generator of the process (e.g., twice continuously differentiable in our case). An 



(1.2) 




TB{x)^M{t:X'={t)eB} 
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interesting feature of the approach we use is that far less regularity is required of the 
Lyapunov function. The paper concludes with the proof of the positive recurrence 
and the uniqueness of the invariant measure for {X^{t)}, which is standard due to 
the uniform non-degeneracy of the diffusion coefficient. 

2. Definitions and Formulation Let G C IRJ' be the convex polyhedral 
cone in M'' with the vertex at origin given as the intersection of half spaces Gj, 
i = 1, - ■ ■ ,N. Let rii be the unit vector associated with Gj via the relation 



Denote the boundary of a set 5 C JR^ by dS. We will denote the set {x G dG : 
{x,ni) = 0} by Fj. For x G dG, define the set, n{x), of unit inward normals to G 
at x by 



With each face Fj we associate a unit vector di such that {di,ni) > 0. This vector 
defines the direction of constraint associated with the face Fj. For x G dG define 



In(a;) = {i e {1,2, ■ ■ ■ N} : {x, Ui) = 0}. 

Let -D([0, oo) : JR'^) denote the set of functions mapping [0, oo) to Si'' that are right 
continuous and have limits from the left. We endow -D([0, oo) : iR*^) with the usual 
Skorokhod topology. Let 

£>g([0,oo) : I&) = {V e D{[Q,oo) : I&) : V(0) S G). 

For 7] e L'([0,oo) : R^) let |?7|(T) denote the total variation of ?? on [0,T] with 
respect to the Euclidean norm on M'^ . 



Gi = {xeMr : {x,ni) > 0}. 



n{x) == {r : |r| = 1, (r, a; — y) < 0, Vy e G}. 




where 
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Definition 2.1. Let ip e Dq i[0,oo) : IR'') be given. Then {(j>,ri) E Z?([0,oo) : 
F^) X D{[0,oo) : M^) solves the Skorokhod problem (SP) for with respect to G 
and d ij and only ij — ?/'(0), and for all t £ [0,oo) 

1. <P{t)^xP{t)+i^{t); 

2. (pit) e G; 

3. <oo; 

4- Hit) = / is^^(^s)€dG}dH{s); 

5. There exists Borel measurable 7 : [0,00) — > W& such that ^{t) G d{(j){t)), 
d\r]\-almost everywhere and 

rj{t) = [ -fis)d\rj\is). 

On the domain D C Dg{[Q,oo) : ]Rl^) on which there is a unique solution to the 
Skorokhod problem we define the Skorokhod map (SM) F as T{il}) = 0, if (0, cj)) 
is the unique solution of the Skorokhod problem posed by ijj. We will make the 
following assumption on the regularity of the Skorokhod map defined by the data 
{{d„n^)■,i^ 1,2, •••TV}. 

Condition 2.1. The Skorokhod map is well defined on all of DgHO, 00) : IR^), 
i.e., D — Dq{[Q,oo) : W&) and the SM is Lipschitz continuous in the following 
sense. There exists a K < 00 such that for all (j>i,4>2 G -Dg([0, 00) : ¥&): 

(2.3) sup |r(0i)(i)-r(</)2)(t)| sup \Mt)~Mt)\- 

0<t<oo 0<t<oo 

We will assume without loss of generality that K > 1. We refer the reader to (or 
alternatively see 0) for sufficient conditions under which this regularity property 
holds. 
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We now introduce the constrained diffusion process that will be studied in this 
paper. Let {fl,J-, P) be a complete probability space on which is given a filtration 
{^t}t>Q satisfying the usual hypotheses. Let {W{t)^Tt) be a n-dimensional stan- 
dard Wiener process on the above probability space. We will study the constrained 
diffusion process given as a solution to cauation lf.il namely, 



where a : G — > W&^^^ and 6 : G — > W& are maps satisfying the following condition: 
Condition 2.2. There exists 7 e (0, 00) for which 



Using the regularity assumption on the Skorokhod map it can be shown (cf. 

that there is a well defined process satisfying ||2Jl. In fact, the classical method of 

Picard iteration gives the following: 

Theorem 2.1. For all x ^ G there exists a unique pair of continuous {Tt\ 
adapted processes {X^{t), k(t))t>o and a progressively measurable process (7(i))t>o 




(2.4) 



\a{x) - a{y)\ + \b{x) - b{y)\ < 7|x - y\; ^x^y^G 



and 



(2.5) 



|cr(a;)|<7; Vcc G G. 



such that the following hold: 



1. X^(t) e G, for allt> 0, a.s. 



2. For all t > 0, 




a.s. 
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3. For all T e [0, oo) 



|fc|(T) < oo, a.s. 



4 




andk{t) = Jl"f{s)d\k\{s) with -f{s) e d{X^{s)) a.e. [d\k\]. 



Remark 2.1. The process X^(-) is the unique continuous {Tt} adapted process 
which satisfies the equation 



The cone C was used to characterize stabihty of certain semimartingale reflecting 
Brownian motions in (J. 
For S e (0, oo), define 



Our next assumption on the diffusion model stipulates the permissible velocity 
directions. 

Condition 2.3. There exist a S ^ (0,oo) and a bounded set A C G such that 
for allxe G\A, b{x) e C{6). 

Finally we will make the following uniform nondegeneracy assumption on the dif- 
fusion coefficient. 




for all t a.s. Also, X''^{-) is a Feller Markov process. 



We now proceed to formulate our central result. Define 

C N 




C{S) = {veC: dist{v,dC) > S}. 



STABILITY OF CONSTRAINED DIFFUSIONS 9 
Condition 2.4. There exists c e (0, oo) such that for all x E G and a € IR'^ 

a' {a{x)a' {x))a > ca'a. 
Here is the main theorem of this paper. 

Theorem 2.2. Assume that Conditions \2. l\\2.iA\2.'A\2.4\ hold. Then the strong 
Markov process {X^{-);x € G} is positive recurrent and has a unique invariant 
probability measure. 

In the rest of the paper we will assume that Conditions 12. II 12.31 and l2. 41 hold. 

3. Stability of Constrained ODEs Let v : [0, oo) — > IR'^ be a measurable 
map such that 

(3.6) [ \v{s)\ds <oo; for all t e [0, c»). 
Jo 

Let X E G. In this section we will study the stability properties of the trajectory 
z : [0, oo) ^ M'' defined as 

(3.7) z{t) = r (^x + v{s)ds^ {t); tG[0,oo). 

It is useful to rewrite the above trajectory as a solution of an ordinary differential 
equation. In order to do so we introduce the following notion of discrete projections 
(cf. 0111). Define ti : ^ G a.s follows: 

where ijjy E D{[0, oo); M^) is given as 

0, te[0,l) 
y, t E [l,oo) 

In other words, tt is a projection that is consistent with the given Skorokhod prob- 
lem, in that the constrained version of any piecewise constant trajectory ip can be 
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found by recursively applying tt. We also define the projection of the velocity v E 
at X £ G hy 

t:{x + Av) — X 
Tr{x,v) = am : . 

For a proof of the fact that the above limit exists we refer the reader to ^ where 
various properties of the projection map are also studied. In particular we will use 
the following facts (for proofs see ^). 

1. For X e G, a, /3, 7 > and v G M'': 

(3.8) Tr{f3x,av + jx) = aTr{x,v) + jx. 

2. For V e M'^, we have that 

(3.9) 7t{v) = if and only if v e C 

The following theorem represents the trajectory in H3.7(l as a solution of an 
ordinary differential equation (cf. [H]). 

Theorem 3.1. Let v : [0,oo) — > R'' satisfy f^i . Then for all x € G, z{-) 
defined via \3. 7| ) is the unique absolutely continuous function such that 

z{t) = Tr{z{t),v{t)), a.e. t, z(0) ^ x. 

In Theorem below we present a basic stability property of the above dynam- 
ical system. 

Theorem 3.2. Let v be as in Theorem Assume that there exists a S G 
(0, oo) such that 

v{t) e C{S) for all t e [0,oo). 
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Let X E G and z{-) he defined via jff. 7| ). Then: 

where K is the finite constant in \2.'^) . 

Proof: In order to specify the initial point of the trajectory we will write the 
trajectory defined by H3.7(l as •). Define the trajectory z(-) as 

z{t) = r v{s)d^ (t). 

Theorem implies that z(-) is the unique solution of 

(3.10) l(i) = 7r(z(i),w(t)), a.e. t; 5(0) = 0. 

However since v{t) e C{5) C C, we have from (|3.9|l that 7r(0, v{t)) = for alH > 
and so the zero trajectory solves (|3.10|l . By Theorem 13. II this implies that z{t) = 0. 
Thus 

sup \z{x,t)\— sup \z{x,t) — z{t)\ 

0<t<oo 0<t<oo 

= sup 

0<t<oo 

(3.11) <i^|a:|. 

The above inequalities in particular show that the theorem is true when a; = 0. 
Henceforth we assume that a; 7^ 0. Define 

^ 5 

and 



+ / v{s)ds (t) - r / v{s)ds (t) 



(3.12) 



i:{t) - {l+jt)z{x,t). 
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Note that from H3.8|l it follows that 

ip{t) = -fz{x, t) + {l+ 7i)7r(z(a;, t), v{t)) 

= TT {z{x, t), (1 + -ft)v{t) + -fz{x, t)) 

- ^ (^m, (1 + It) (^vit) + 

By Theorem 13. II we now have that i/j{t) = r{x + f{-)){t) for all t S [0, oo) where 

rt 



z{x, s) 



Note that from H3.11|l it follows that 



z{x, t) 



1 + 7^ 



< K\x\ 



K\x\ 



e C. 



Thus if w G C{5) then v + ■p-^2_2;(a;, t) g C. From this observation it follows that 
for all t e [0, oo) 

u{t) = (1 + 7t) (^{t) + Y^-^(^' 
Define the trajectory 

^(t) = r(/(.))(t); [o,(X3) 

Then solves the equation 



(3.13) 



m^<mMt)); V^(0)-0. 



Since for all t E (0, oo), u{t) E C wc have that 7r(0,u(i)) = 0. Thus the fimction 
x{t) = for all t G (0,oo) is a solution of l|3.13|l . Now by the uniqueness of the 
solution of (Theorem EH) we have that ■0(i) = for all t e (0, oo). Thus 

m)\^\m-m\ 

<|r(x + /(.))(t)-r(/(.))(t)| 



< K\x\ 



STABILITY OF CONSTRAINED DIFFUSIONS 13 
for all t e (0, oo). Finally from l^J^ 

\z(x,t)\s ^^^^ 

■ 

For X G G and S e (0, oo) let A{x, S) be the collection of all absolutely continuous 
functions z : [0, oo) — > M'^ defined via (|3.7|l for some v : [0, oo) ^ C{S) which satisfies 
H3.6|l . Henceforth we will fix such a 5 and abbreviate A{x, S) by A{x). 

For a fixed a; e G, we now define the "hitting time to the origin" function as 
follows: 

(3.14) T{x) = sup inf{t e [0,oo) : z{t) = 0}. 
We next study some of the properties of T{x). 

Lemma 3.1. There exist constants c,C £ (0, oo) depending only on K and 5 
such that the following holds. 

(i) For all x^y € G 

\T{x)-T{y)\<G\x-y\. 

(n) 

T{x) > c\x\. 

Thus, in particular, for all M € (0, oo) the set {x G G : T{x) < M} is compact. 
(Hi) Fix X G G and let z € A{x). Then for allt>0 

T{zit))<iT{x)-t)+. 

Proof: We first show that for all a; € G 

(3.15) T{x) < —\x\. 
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Fix X e G and let z E A{x) be arbitrary. From Theorem 13.21 we have that for aU 
t e (0,oo) 

Hence for all i > Ti = 2K'^S~'^\x\ one has \z{t)\ < \x\/2. In general, if 

n-l 

k 



T„ = Ti ^ 2 



k=0 

then for t >Tn one has that 



Thus z(<) = for aU t > 4:K^6^'^\x\. Since z e y4,(a;) is arbitrary, l|TT3|l follows. 
Now let x,y E G he arbitrary. Let {zn} C A{x) be a sequence such that if 

Tn = inf{t : z„(i) = 0}, 

then 

(3.16) Tn T{x) as n — > oo. 

Note that z„ is given as 

Zn{t) = T [x 



+ vn{s)ds^ (0; t e [0,00) 



for some i;„ satisfying (|3.7() . Define for t e [0, cx)) 

From the Lipschitz property of F (Condition |OJ we have that 

sup \Zn{t) ~ Wnit)\ < K\x - y\. 
0<t<oo 

Also clearly Wn G A{y). Now let 

Tn = inf{< e (0,cx)) : w„(i) = 0}. 
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Fix n and suppose that r„ < r/^. Then 

|'w„(r„)| = |w„(t„) - 2;„(t„)| < K\x - y\. 

Hence from (|^T^ . lettmg C = 4i^3^-i^ 

< < T^ + C\x-y\. 

Similarly it can be seen that if < r„ then 

Tn < T^,+C\x-y\ 

and thus 

\Tn - <| < C\x - y\. 

We therefore have that 

Tn<T^, + C\x~y\<T{y) + C\x-y\. 

Sending n ~> oo, it follows from ()3.1fci|l that 

T{x)<Tiy) + C\x-y\. 

Since the role of x and y can be reversed, we have that 

\Tix)~Tiy)\<C\x~y\, 

and since x and y are arbitrary we have (i) . 

Next we show (ii). Fix some v e C{S), and let x E G\{0} be given. With 
[0, oo) — > [0, co) denoting the identity map, clearly the trajectory {r(a; + vi){t)}t 
belongs to A{x). Note that 

sup \T{x + vL){t) - x\ ^ sup \T{x + vL){t) -T{x + OL){t)\ 

0<t<AI 0<t<M 

< KM\v\. 
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Therefore for any M < \x\/K\v\ 



0<t<M 



mf \r{x + VL){t)\>\x\-KM\v\>0, 



which impUes that T{x) > M. Taking the supremum over M < \x\/K\v\ gives 



This proves (ii) with c = 

Finally we prove (iii). Let t > he fixed. If T{z{s)) = for some s e {0,t\ then 
the result is obviously true. Now suppose that T{z{s)) > for all s G [0,t\. Let 
/3 > be arbitrary and u G A{z{t)) be such that r = inf{s G [0,oo) : u{s) = 0} 
satisfies r > T{z{t)) - (3. Define z : [0, oo) M'' by 



Then z G A{x) and 

T{x) > inf{s G [0, oo) : z{s) = 0} 

= t + T 

>T{z{t))+t- p. 

Since /3 > is arbitrary we have that T{z{t)) < T{x) — t. This proves the lemma. ■ 

4. Stability of Constrained Diffusion Processes We begin with the fol- 
lowing lemma. For x G G, let 0,o{x) be a P— null set such that for all w ^ flo{x) 
and < u < t < oo, X^{-) = X^{-,ij) satisfies 

= r ( + / b{X''{u + s))ds+ [ a{X''{u + s))dWuis)] (t-u), 




where Wu{s) = W{s + u). 
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Lemma 4.1. Let T be the function defined in jl3.14^ . Fix x ^ G \ A and let 
{X^(t)}f>o be as in Theorem \2.}A Let A > and u > be arbitrary. Fix lo ^ ^q{x). 
Suppose that X^{t, lu) G G\A for all t G {u,u + A]. Then 

r(X^(w + A,w)) < {T{X^{u,uj)) - A)+ + KCV{u;), 

where C is as in Lemma \3.1\ (i) and 



(4.17) 



u = sup 

ii<s<ii+A 



(T{X''{s))dW{s) 



Proof: In the proof we will suppress uo from the notation. We begin by noticing 
that for i G [u, u + A), = X{t ~ u), where 



X{t)=T[X''{u) + J b{X''{s + u))ds 



+ j a{X'''{s + u))dW^{s)j{t); < t < A. 
Now define a sequence of M'' valued stochastic processes {^"(i)}o<i<A as follows. 



(4.18) 



Y{t) ^ r X^(u) + / fe(X^(s + u))ds {t) 



Note that Y{t) has absolutely continuous paths P-a.s., and that b{X^{s + u)) G C{6) 
for all s G [0, A]. Also, note that by Condition 12 . II we have 



sup \X{t) - Y{t)\ < K sup 

0<t<A 0<t<A 



a{X''{s + u))dWu{s) 



(4.19) = KV. 

Using the Lipschitz property of T fLemma l3.1l {\\) we have that 
T(X^(u + A)) =T(1(A)) 

< T{Y{A))+KCV 

< iT{X^{u)) - A)+ + KCV, 
where the last inequality follows from Lemma 13.1^ 111. ■ 
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Lemma 4.2. Suppose that {ai{t)}; i = 1,2, - ■■ ,1 are M'' valued a{W{s) : < 
s < t} -progressively measurable processes such that there exists a G (0, oo) for which 

\ai{t)\ < a, 

for all t e (0, oo), i €{!,■■■ ,1}, P-a.s. Then for A e (0, cxd) 
where {■,■) is the usual inner product in ]R!^ . 



Proof: We first consider the case wlien 1 = 1. Observe that 

E fcxp (\ f {aiis),dW{s)) - ^A^ / \ai{s)fds 11=1 



and 



E (^cxp (^-^ {ai{s),dW{s)) - ^A^^ \ai{s)\^ds 
Using the upper bound on |q!i(-)| we now have that 



1. 



exp A 



{ai{s),dW{s)) 



< exp A / {ai{s),dW{s)) 



+ E (^exp {^^ {ai{s),dW{s)) 



< e 2 +62 



This proves the lemma for the case I = \. Now we consider the case l> \. Note 
that 

(e 2 j 



< 2 
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2e — ^ 



In what follows, wc will denote the set of positive integers by IN. 



Lemma 4.3. Let x ^ G and A > fee fixed. For n d IN let Vn be defined as 
follows: 



(4.20) 



l^n = sup 

(n~l)A<s<nA 



'(ri-l)A 

Then for any k € (0, oo) and m,n Cz IN ; m < n, 
where 7 is as in Condition[ 



a{X^is))dWis] 



(n— m+1) 



Proof: For t > 0, let 



= a{W{s) : < s < t}. 



Then 
(4.21) 
Now 



IE (e'^"" I ^(„_i)a) = E sup e 

\ (ri-l)A<s<nA 



«|/('„-i)a'^(^"("))''W/(«)| 



^ sup e ^("-i)^ ^ 'I 

\ {n-l)A<s<nA 



Q{n~l)Aj 

X-((n-l)A) 



where the last step follows from the Markov property of X^. 

An application of Doob's maximal inequality for submartingales yields that the 
last expression is bounded above by 

„2«|/("„^i)a'^(-^H)'^W'(«)| 



2 \ E\ e Mt"-!)^ 



X-((n-l)A) 
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By an application of Lemma 14.21 and the observation that for positive real numbers 

Xi, ■ ■ ■ Xk, \jYli=i — Si=i have that the last expression is bounded above 

by 

Using this observation in H4.21|l we have the result by iterating. ■ 
For A > let 

= {2/ e G : T{y) < A}. 
Let {X^{t)}t>Q be as in Theorem 12. II Given a compact set B C G, let 
(4.22) tb{x) :^M{t: X'^it) e B}. 



Theorem 4.1. Let {X^{t)}t>o be as in Theorem \2.'A Then there exists A g 
(0, oo) such that for all M e (0, oo) 

sup 1E{tb^{x)) < oo. 

x:\x\<M 

Proof: Without loss of generality we can assume that A is chosen large enough so 
that D A. 

Let A e (0, oo) and let 

An = {uj : inf T(X"=(s)) > A}. 

s£[0,nA] 

Then 

P{An) < P ^A < r(X^(nA)) < T{x) -nA + CKj^ 

(4.23) 



STABILITY OF CONSTRAINED DIFFUSIONS 21 

where {z^j}"^! are as in 1)4.20(1 and the inequahty follows from Lemma [4.11 Next 
observe that the probability on the right side of (|4.23|) is bounded above by: 



< 



gQ((n+l)A-T(2;)) 



where a > is arbitrary and the next to last inequality follows from Lemma |4.3I 
Choose A > (sufficiently large) and a > (sufficiently small) such that 
„2 2^2 7^2 2 _ , log 8 



2A 



Then 



PiX'^is) ^ B^;0< s <nA) = P{A„) 

pOLT{x) 

< p-r,(«+l)A 

- e("-';)A'^ 

for all n E IN. Now let t S (0, oo) be arbitrary and uq be such that t E [noA, (no 
1)A]. Then 

P(tba (x) > t) = P(X^(s) (^B^;0<s<t) 

< P(X^(s) (^B'^;0<s< uqA) 

paT(x) 

< _E p-r,(no + l)A 

- g(a-,,)A^ 

aT(x) 

Hence 

/•oo 

IE{tb'^{x)) ^ / P{tb^{x) > t)dt 
Jo 

paT{x) i-co 
- e(a-r,)A 
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paT{x) 



(a— ?))A ■ 



Recalling that T(-) is a continuous function wc have from the above inequality that 
for all M e (0, oo) 

sup 1E{tqa{x)) < oo. 

x:\x\<M 



Lemma 4.4. For x e G let {X^{t)}t>a be as in Theorem [EE Then for all 
M € {0,oo) the family {X''{t);t> 0, |x| < M} is tight. 

Proof: Let A > be large enough so that D A. Fix oj € f2o(a;), where rio(a;) is 
as defined at the beginning of this section. In the rest of the proof we will suppress 
the dependence of all random variables on uj in the notation. Let 

S{A) =^ {j e {1, 2, • • • , n - 1} : T(X^(t)) < A for some t G [(j - 1)A, jA)}. 



Define 



max{j ; j G S'(A)} if S{A) is non empty 







From Lemma [4. II we have that 



otherwise. 



(4.24) r(X^(nA)) < r(X^(TOA)) + ^ {KCvj ~ A). 

j—m-\-l 

Let 

t = sup{s G [(m - 1)A, mA) : T(X^(s)) < A}. 
If TO > 0, we have from Lemma [4. II that 



r(X^(TOA)) < {T{X%t)) - (toA - t))+ + KC sup 



<A + KC sup 

t<s<mA 



t<s<mA 

(T{X''{u))dW{u) 



a{X''{u))dW{u) 
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< A + 2KC sup 

(m-l)A<5<mA 

= A + 2KCv„,, 



(T{X''{u))dW{u) 



(m-l)A 



where in obtaining the second inequality we have used the fact that for (m — 1) A < 
t< s < mA 



a{X'={u))dW{u) 



< 



a{X''{u))dW{u) 



(m-l)A 



a{X''{u))dW{u] 



(m-l)A 



Using this observation in H4.24(l we have that 

n 

T(X^(nA)) < T{x) + 2A + ^ {2KCi^j{x) - A) 



< T{x) + 2A+ max ^(2ii'Ci^j(x) - A), 



1=1 



where we have written Vj = Vj{x) in order to exphcitly bring out its dependence 
on X. Hence for Mq £ (0, cxd) 

P(T(X"'(nA)) > Mo) < P \ max 'f^{2KCvj{x) - A) > Mq - T{x) - 2A 

I KKn ^ — ^ 

71 I n 

< ^ P 2KC^Vj{x) > Mo + {n-l-l)A- T{x) 
1=1 \ j=i 



^ 1=1 



ga(n — /) A 

where a > is arbitrary. From Lemma 14.31 wc now have that 



Pinx^inA)) > Mo) < ^.M. E- 



< 



ga(2A + r(.)) ^ .«.„^2p2j^2^2^_^^^loa8)(„_,^^) 



/=1 



Now choose a and A so that 



a^C^K^j^A - aA 



fogf 



-0 < 0. 
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Then 

a{2A+T{x)) " 

P(r(X-(nA)) > Mo) < ^„Mo E^''^"''^ 

1=1 

^a(2\+T{x)) 

< 



eaA/o(i_e-e)' 
Hence for all M,Mo G (0, oo) 

a(2A+lf2.M) 

sup P(T(X-(nA)) > Mo) < 

nGlN,\x\<M e "[L — e ) 

From Lemma l3. II fii) it now follows that 

P(A"(nA) > Mo) < ■ 

nelN ,\x\<M 



,a(2A+iflM) 

(4.25) sup P(X-(nA) > A/o) < ;.,Mo(i „ ■ 



Now let t € [nA, (n + 1) A] and consider the process {i^(i)}o<t<A defined in (|4.18() 
with u there replaced by nA. For each n it follows from H4.19|l that 

\X'-'{t) - Y{t - nA)| < Kvr,{x). 

Define a function b : G which agrees with & off A and satisfies Condition l2.3l 

with yl = as well as equations (|2.4|l . Also define 

Y*{t) ^ r (^X^(nA) + ^ 6(X^(s + nA))ds^ (<). 

Clearly 

L = sup \h{x) — b[x)\ < oo. 

x&G 

Furthermore 

\Y{t - nA)| < \Y{t ~ TiA) ^Y*{t- nA)| + \Y*{t - nA)\ 

< KLA + K\X''{nA)l 

where in obtaining the last inequality we have used the Lipschitz property of F and 
Theorem 13.21 Combining the above observations we have that 

\X^t)\ < K{y,,{x) + |X"(nA)|) + KLA. 
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Therefore for Mq e (0, oo), any n, and t E [rtA, ?iA + A] 



2K J \ J 



(4.26) 



Clearly, the family {|i/„(a;)|; n > 1, |a;| < M} is tight. Now let r/ > be arbitrary. 
Choose Mq G (0,oo) such that 



/ , . M Mq- KLA\ Tl 

sup P ( \Mx)\ > j < ' 



nelN,\x\<M 

and 

ga(2A+ifiM) ^ 

<^c(Afo-ifLA) 7~ ^ 

Then from (|4.25|l and (|4.2t)|) we have that 



sup P{\X-{t)\>Mo)<V- 

t>0,\x\<M 

Since 77 > is arbitrary, we have the result. ■ 



From Theorem l4.1l Lemma l^^ and Condition l2.4l the proof of positive recurrence 
and the existence and uniqueness of an invariant measure for {X^ {t)}t>Q is standard 
(cf. [HI). However for the sake of completeness we present the proof below. 

Proof of Theorem l2.2t Denote the measure induced by {X^(-)} on C([0, 00) : G) 
by Px, where C([0, 00) : G) is the space of G valued continuous functions defined 
on the nonnegative real line. In arguments that are presented below, it will be 
convenient to let initial conditions be defined through conditioning, rather than 
though the superscript as in . As a consequence, instead of X^ we will work with 
the canonical process ^(•) on C([0,cx)) : G), and the canonical filtration which we 
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denote by {J-t}- Finally, the expectation operator corresponding to the probability 

measure Px will be denoted by lE^ ■ Given a compact set B C G, let 

TB = inf{t : m e B}. 

In order to show positive recurrence, we need to show that if S is an arbitrary 
compact set in G with positive Lebesgue measure then for all a; G G, lE^fs < oo. 
Let B"^ be as in Theorem EH and let r € (0, oo) be such that B^ C {x : \x\ < r}. 
Then from Theorem 14. II we have that for all C G (0, oo) 

(4.27) sup Ex{fB^) < oo, 

x:\x\<C 

where Br = {x d G : \x\ < r}. From the uniform non degeneracy assumption 
(Condition inHJ), we have (cf. [ED 

p{S) = inf P,(e(l) eS)>0. 

Furthermore, Feller property of {X^{-)} implies that the family {X^{t) : x e 
Br, < t < 1} is tight, and so there exists M e (0, oo) such that 

(4.28) inf PxiCil) e S and \^{t)\ < M for all t e [0, 1]) > 
Let G G (M, oo) be fixed, and define 

f = M{t:m\>C} 
and f = min{l, f, fg}. If y G Br, then by the strong Markov property 

< Ey {f + ]E^^,){fs)) 

(4.29) < I + ]Ey {]E^^,)ifs)) . 
Now define 

A = {^(•) G C([0,oo) : G) : sup \^{t)\ < M and ^{l) e S}. 

0<t<l 
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Since E^(^f){fs) — w.p.l if ^ e A, for y e Br 

(4.30) = Ey (lA^OlEaM^s)) ■ 

Next, fix z e G such that \z\ <C. Then 

E,{fs) ^ E,{fB^ + {ts - fB^). 
Once more using the strong Markov property, we have 



E,{fs) < E, + sup E,{fs, 
(4.3f) < sup E,{fB^)+ sup E,{fs). 

z:\z\<C xeBr 

Observing that |^(f)| < C and combining H4.30|l and H4.3f|l we have that for y ^ Br 
(4.32) Ey {E^^f){fs)) < { sup E,{fB^)+ sup E,{fs)] Py{A^l- 

\z:\z\<C xeB^ J 

From iB^ . and it now follows that 

sup Ey[fs) < 1 + sup E,{fB^ + ( 1 - ^ ) sup IEx{ts)- 

yGB^ z:\z\<C \ ^ J xeBr 

Thus 

sup Ey{fs) < I 1 + sup E^fB,) \ . 

yeB,^ P[b) [ z:\z\<C J 

A final application of the strong Markov property now yields that for x d G 

E^{ts) < E.,{tb^ + sup Ey{Ts) 
ye Br 

<^.(tbJ + -^ J 1+ sup E,{tb,.)\ 

PiS) [ z:\z\<C J 

< CXD, 

where the last inequality follows from Theorem 14. II and H4.27|l . This completes the 
proof of positive recurrence. 
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Finally we consider the existence and uniqueness of invariant measures. From 
Lemma 14.41 we have that the family of measures {/it;i > 1} defined by 



is tight. Since the Markov process {X^{t)} is Feller we have that any weak limit 
of {fJ-t} is an invariant measure. (See, for example, the proof of Theorem 4.1.21, 
Chapter I, HOI)- Finally uniqueness follows as in in view of Condition 12.41 ■ 

Remark 4.1. The Lipschitz and growth condition ( Condition \2. ij)) on b and a 
are essentially assumed to guarantee a unique solution to the constrained diffusion 
process which is Feller Markov. The conclusion of Theorem \2.S\ continues to 

hold with the same proof if Condition \2.'A is replaced by the assumption that \2. .'?)) 
holds for some 7 G (0, 00), b is locally bounded and ijj. j|) has a unique weak solution 
with continuous paths for every x £ G and the solution is Feller- Markov. 
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